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CROSS-REFERENCE TO RELATED APPLICATIONS: 

This application claims the benefit of PPA Ser. Nr. 60/444,413, filed 2003 Feb 02 by the 
present inventors. 
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BACKGROUND OF THE INVENTION— FIELD OF INVENTION 

This invention relates to music, and in particular, to enhance the instrumentalists 
ability to perform musical scores. 
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BACKGROUND— DISCUSSION OF PRIOR ART 

U.S. patent 6,201,174 to Eller (2001) discloses a computerized tablature composer 
that generates tablature notation from conventional staff notation. This is shown in the 
prior art figure, step 602. However, how to perform this step is not obvious, and Eller's 
patent gives no indication on how to do this. In addition, Eller's patent does not generate 
an automated fingering sequence in order to perform the musical composition efficiently. 

U.S. patent 5,396,828 to Farrand (1995) discloses a means for automatically 
producing guitar fingerboard information for chords from staff notation. Farrand's 
invention analyzes the music for various instruments and produces guitar chords that fit 
the harmonic rhythm of the melody, it does not give the fingering positioning of the exact 
notes in the staff notation that a guitar would play, and it only deals with chords, not 
individual notes of the melody. For example, in U.S. patent 5,396,828 figure 14, the first 
measure of the music depicts a D chord in second position on the guitar fingerboard; this 
is not, however, how the three notes shown in the staff of the music would be played by 
the guitar (i.e., Farrand's chord does not depict the exact voicing of the chord from the 
staff notation). 

U.S. patent 5,639,977 to Hesnan (1997) discloses a music learning aid that 
displays playing instructions associated with musical notes. However, Hesnan's invention 
does not give an automated means for determining optimal or secondary fingering of an 
instrument for a given musical piece. 

Various patents (e.g., U.S. patents 5,533,903, 5,639,977, 5,690,496, and 
6,388,181) discuss the depiction of musical instrument fingering. However, none of them 
provide a method for automatically determining the fingering information. 

BACKGROUND OF THE INVENTION 

From the beginning of notated music, musicians have been composing music for 
other musicians to learn and perform. In classical staff notation, many composers have 
had or have the added skill of adding the symbols required, given a particular instrument, 
to explain the actual fingering of the musical score to be performed on the instrument by 
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designating the fingers on the instrument for specific notes to accomplish the 
performance of the musical piece. That is called symbolic fingering notation. It is 
extremely important to the overall musical sound that the musical staff notation for each 
instrument have the proper symbolic fingering notation to maximize the efficiency of 
playing and control of time and sound (i.e., a way of the composer and virtuoso 
performer tell where to put your fingers). If fingering is added to a score, it is by this 
manual method and not automatically generated. 

Although most string instruments also use some kind of tablature to determine the 
string length or pitch to be expressed other than standard musical notation, tablature is 
inefficient for the performer to play the piece since tablature only depicts the string length 
and not the proper fingering required to perform a musical composition. 

The "Method of Automated Musical Instrument Finger Finding" is designed to 
automatically analyze musical data, which includes musical score and tablature data, and 
notate proper fingering for a musical instrument for someone to enhance their ability to 
play the music. 

By far, most musical scores using both standard staff notation and/or tablature 
will not include fingering for the musician's maximum performance. Even if one does, 
the musician might want one or more fingering options of the score or portions of it. This 
invention analyzes music data (staff notation and/or tablature) for an instrument and 
provides the musician with the best possible fingering by predetermining what fingering 
to use for the instrument from the musical data. Range of notes, for example, would be a 
determining factor in the fingering. Other important factors would be tone, speed of 
performance, and the ability to play relaxed or natural to the physical limitations of one's 
skill level. Consequently, this invention also generates intelligent secondary options for 
the selection of fingering. 

This invention would not only be useful for composers, but also for teachers 
explaining to their students the best way to play a musical composition, by music 
publishers allowing them to scan musical scores and have a "performance ready" printout 
of the music to sell, and by the performer who could now take any music-available within 
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the range of his instrument and use this invention to come up with a professionally 
correct fingering for the performance. This would be a tremendous time and labor saver. 

BACKGROUND OF INVENTION— OBJECTS AND ADVANTAGES 

Accordingly, several objects and advantages of the present invention are: 

(a) To decrease the costs and decrease the time-to-market of publishers getting 
music published with professional fingering information. 

(b) Enhance performance and publication of music originally composed for one 
instrument to be easily performed on other instruments. 

(c) Enhance sale of publication of music by making the music more easily 
playable. 

(d) Music composition software would be enhanced and more attractive to 
customers with the addition of the finger finding feature of this invention. 

(e) Enhance composers' ability to compose by giving them knowledge on the 
ease of payability of their composition on an instrument. 

(f) To enhance the ability of the performer with secondary options of fingering 
on their instrument. 

(g) Enhance teaching abilities by teaching students how to play instruments for 
which the teacher is not as skilled on. 

Further objects and advantages of the present invention will become apparent 
from a consideration of the drawings and ensuing description. 

SUMMARY 

In accordance with the present invention a method of generating the optimal and 
secondary fingering for a given musical instrument from musical score and/or tablature 
data. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig 1 illustrates an exemplary computing system for use in conjunction with an 
embodiment of the Finger Finder invention. 

Fig 2 illustrates the operational characteristics of the Finger Finder. 

Fig 3 is a flowchart giving the steps performed by the Finger Finder invention. 

Fig 4 illustrates an exemplary composition input for an exemplary embodiment of 
the Finger Finder invention. 

Fig 5 illustrates one of the options for the exemplary composition input for an 
exemplary embodiment of the Finger Finder invention. 

Fig 6 illustrates an exemplary embodiment of the Finger Finder invention where 
the complete fingering of a guitar composition is shown by the embodiment. 
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220 Positional Range Group 

222 Transition from group 214 to group 228 
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316 Adding Stroke To Existing Group 
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356 Determining Hand Position On Instrument For Group 

358 Determining Fingering Positions For Strokes In Group 

360 Marking Group As Unused Once It Is Finished 
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DETAILED DESCRIPTION OF THE INVENTION 

Fig 1 shows an exemplary computing system for use in conjunction with an 
embodiment of the Finger Finder invention. Here, the Finger Finder invention is 
executing on 100, with its input (a musical composition for an instrument) coming from 
some kind of input device, like: 

• A tablet 102 where a user would enter a composition onto the tablet with a pen 
type of device. 

• A scanner 104 that a user would use to scan in sheet music. 

• A mouse 106 likely used in combination with a keyboard 108 that a user would 
use to enter a composition. 

• A microphone 110 that a user would play a musical instrument into to digitize 
and automatically notate the played composition. 

• A MIDI device 112, like a common kind of electronic keyboard, a user could 
connect directly to their computer and play and automatically notate the played 
composition. 

• A data storage device 114 where a previously stored composition could reside. 

• A computer network (a LAN or a WAN, like the Internet) 120 where the 
composition could come from a remote machine. 

The output of the Finger Finder invention could be: 

• Sent to a MIDI device 112 that can make use of the data. 

• Placed on a data storage device 114 for later retrieval or electronic publishing 
purposes. 

• Shown on a monitor 116 for viewing in a teaching or composition creation 
environment. 

• Printed to a plotter or printer 1 18 for paper publishing purposes. 

• Sent across a computer network 120 for remote analysis, paper or electronic 
publishing, or data storage or sharing purposes. 
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This invention automates the determination of instrument finger finding by the 
method of gathering and analyzing stroke groups. Figure 2 illustrates this. This figure is a 
plot of physical instrument position 200 in the horizontal dimension versus time 202 in 
the vertical dimension (time increasing going down). Thin individual boxes, like box 204, 
represent the strokes, and a group of strokes are surrounded by a thicker box, like box 
206. The horizontal dimension of the group boxes represents positional range that the 
group of strokes can be played at; that is, the hand on the instrument can play all the 
strokes in the group in one place. 

For the example shown in figure 2, the first several strokes can be played either at 
the positional ranges within group 206 or group 208. Afterwards, the next couple of 
strokes can only be played within group 206. For fingering determination based on 
efficient hand movement, group 208 would be discarded in favor of playing the first 
several strokes all within group 206 as no hand movement is required. However, an 
embodiment of this program may give the user an option to prefer playing all or some of 
the strokes in group 208 based on easier fingering of the instrument or preferable tonal 
qualities of the instrument at this position over the position of group 206. This preference 
may be based on manual input by the user, or based on a setting within the program 
giving preference to one or more locations. 

Likewise, there are some strokes afterwards that can be played either in group 206 
or in group 210, followed by strokes only being able to be played in group 206. Again, 
for efficient hand movement, group 206 would be preferred, unless overridden by a user 
preference for other locations based on other criteria. 

At a time later, there are a set of strokes that can either be played within group 
206, 212, or 220, followed by a set of strokes that can be played within group 206, 212, 
220, or 214, followed by a set of strokes that only be played within group 214. Unless 
overridden by user preferences to the contrary, the finger finder would choose the strokes 
to be played within group 206, transitioning to group 212 (via transition 216) at a musical 
key boundary, and then transitioning to group 214 (via transition 218) at a musical key 
boundary. (A musical key boundary would be marked, for example, as a C note in the 
key of C.) In this manner, there are two transitions from group 206 to group 214, each 
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transition giving the minimal hand movement across the instrument. Another user 
preference, however, may be to minimize the number of hand transitions, and so all the 
strokes would be played within group 206 followed by a direct transition to group 214 
where the strokes within that group would be played until a transition to another group 
would be required. 

The determination of going from group 206 to group 212 to group 214 was based 
on the fact that there were strokes that could only be played in group 214, that group 206 
had to be started at since starting at group 208 would have required an undesirable hand 
transition to group 206, that going to group 210 was undesirable as another transition 
back to group 206 would have been needed, and that going to group 212 was desirable as 
that provided an intermediate minimal hand transition. 

A second set of circumstances is shown following the strokes played within group 
214 and transitioning to group 228 via transition 222. At this point, there are multiple 
places to play the rest of the strokes. In this case, group determination is done by 
determining the minimal total path distance; that is, the total hand movement not just 
from one group to another, but taking into account all of the combinations of group 
traversal until the last stroke. 

For example, from group 228, either group 226 or 230 would have to be 
transitioned to as there is a set of strokes that can only be played in group 226 or 230. 
From group 226 a transition to group 244 is required, and from group 230 a transition to 
group 242 or 226 would be required. From group 244 a transition to group 246 or group 
250 would be required, and from group 242 a transition to group 250 would be required. 
The actual group transition sequence, without user preference overrides, would be 
determined by the minimum of the following transitions: 

(i) Transition 234 + transition 236 + transition 248 

(ii) Transition 234 + transition 236 + transition 240 

(iii) Transition 232 + transition 238 + transition 252 

(iv) Transition 232 + transition 224 + transition 236 + transition 248 

(v) Transition 232 + transition 224 + transition 236 + transition 240 
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In case of multiple paths having the same minimal total distance, the Finger 
Finder would prefer the path with the most right or left, or top or bottom, as appropriate 
for the instrument under consideration, number of groups. 

Fig 3 is a flowchart illustrating the steps performed by the Finger Finder 
invention, according to an exemplary embodiment of the invention. Figure 3A shows the 
steps required for determining all of the groups and the strokes associated with the 
groups. Figure 3B shows the steps required for determining which groups are to be used 
for Finger Finding purposes. Figure 3C shows the steps required for determining the 
actual fingering positions on the instrument. 

Step 300 is the entry in to the Finger Finder invention. The data input to the 
Finger Finder is the composition data of a musical instrument, as illustrated by fig 4. 

Step 302 is the initialization activities of the Finger Finder. Activity variables are 
shown in this block that are used to qualify other activities later on. Activity variable 
NumStrokes represents the total number of strokes in the composition; this number is the 
actual number of fingering positions, where any repeated sequences in the composition 
are taken into account and duplicated and placed in the input stream. Activity variable 
Strokeldx represents an index into the strokes, where index value 0 accesses the first 
stroke of the composition, and an index value of (NumStrokes - 1) accesses the last 
stroke of the composition. Activity variable NumGroups represents the total number of 
positional range stroke groups that this flowchart creates. 

Item 304 is a decision point. If all of the strokes in a composition have been 
handled (by creating positional range groups and assigning the strokes to these groups), 
then the Finger Finder next determines which groups are to be used for Finger Finding 
purposes, starting with activity 328. 

Activity 306 is the retrieving of all of the positional ranges on the instrument that 
the stroke under consideration can be played at. Activity 308 is the initialization activities 
required to access the different positional ranges of the stroke. 
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Activity 310 is a decision point. If all of the positional ranges of the current stroke 
have been handled, then activity 312 is branched to; otherwise, activity 314 is branched 
to. 

Activity 312 is the activity required to access the next stroke. 

Activity 314 is a decision point. If a positional range stroke group already exists 
at the current time (meaning that the previous stroke and the current stroke share a 
common group), then activity 316 is performed; otherwise, activity 318 is performed. 

Activity 316 associates the current stroke to an existing positional range stroke 
group. Activity 318 creates a new positional range stroke group and associates the current 
stroke to this new group. Activity 320 increments by one the count of the total number of 
groups, to be used later. 

Activity 322 is a decision point. If there is only one positional range group that 
the current stroke can be played in, then activity 324 is performed, in which the stroke is 
marked as a "termination point" (i.e., a stroke that can only be played in one group). 
After activity 324 or if the stroke can be played within multiple groups upon arriving at 
activity 322, activity 326 is performed, which is done in order to access the current 
stroke's next positional range group. 

Activity 328 is the initialization activities required to determine which groups are 
used for the purposes of finger finding. As before, Strokeldx is the variable used to 
access the strokes in the composition. Activity variable LastStrokeldxHandled represents 
the index into the strokes that was last handled by the activities of figure 3B. 

Activity 330 is a decision point, where if all of the groups have been found, then 
the flowchart starts the activities of determining the actual fingering, starting with activity 
348. If all the groups have not yet been handled, then activity 332 is gone to. 

If a stroke under consideration can only be played within one positional range 
group (the stroke is a "termination point"), activity 332 branches to activity 336, and if 
there was a previous termination point, then activity 336 branches activity 342 where the 
shortest path to the previous termination point is found, as described for figure 2, where 
the groups that are used are marked as such for later. If there was no previous termination 
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point, then activity 336 branches to activity 340 where the shortest path to the first stroke 
in the composition is found, as described for figure 2, where the groups that are used are 
marked as such for later. 

If the current stroke is not a termination point, then activity 332 branches to 
activity 334, where if the current stroke is the last stroke in the composition, then activity 
334 branches to activity 338 where the shortest path to the previously handled last stroke 
is found (which may be the first stroke of the composition if there are no termination 
points), as described for figure 2, where the groups that are used are marked as such for 
later. 

After activity 338, 340, or 342 is performed, activity variable 
LastStrokeldxHandled is set to the current stroke index in order to find the shortest path 
from a later stroke to this stroke (if this is not already the last stroke). 

If the current stroke is not the last stroke of the composition in activity 334 or 
after activity 344 is performed, activity 346 is performed, which is the activity required to 
access the next stroke in the composition. 

Activity 348 is the initialization activity required to find the actual fingering of 
the instrument for the strokes in the composition, which then branches to activity 350. If 
all the strokes have been handled, then activity 350 exits the Finger Finder via 364; 
otherwise, activity 352 is entered. 

Activity 352 finds the group used for the stroke under consideration then goes to 
activity 354 which goes through the group to find and stroke at or crossing a key 
boundary to the next used group. Activity 354 leads to activity 356 which determines the 
hand position on the instrument; this is based on the previous group that is being come 
from, if any, and the number of fingers needed to play the strokes in the group. For 
example, if not all the fingers on the hand are needed to play the strokes, then the hand 
may be able to transition to the position in such a way as to minimize the transition 
distance (and therefore transition time), so that a stroke that would normally be played by 
one finger will actually be played by another. 
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Activity 356 leads to activity 358, where, based on the hand position on the 
instrument, the fingering positions on the instrument is determined for the strokes in the 
group up to but not including the key boundary stroke. After this, the group is listed as 
unused in activity 360 so the group that the next stroke is in can be found. Afterward, 
activity 362 is performed, which is required in order to access the first stroke in the next 
group. 

Fig 4 is a diagram illustrating an exemplary composition input for an exemplary 
embodiment of the Finger Finder invention, as would be fed as the input to the Finger 
Finder of fig 3 item 300. This figure shows how a composition for a musical instrument 
can be implemented as a composition container (e.g., a C data structure or a C++ or Java 
class) 400 being composed of a 1 or more composition line containers 402, which are 
themselves composed of one or more measure containers 404, which are themselves 
composed of one or more stroke containers 406. This figure also shows that a note 
container 408 and a chord container 410 are subtypes of the stroke container 406, and that 
a chord container 410 is composed of two or more note containers 408. 

Different variations of this could be implemented as input to the Finger Finder. 
The above scheme works fine if the key of the composition is maintained with the line 
object 402, where different lines could be in different keys. The key could alternately be 
maintained in the measure container 404, which could then remove the need for a line 
container 402. 

The measure container 404 is handy for containing information about such 
measure related information as the beginning measure and the end measure of a repeated 
sequence, so that the Finger Finder can find strokes that aren't necessarily next to each 
other as written on sheet music. Alternately, the software that creates the input for the 
Finger Finder could create a data structure such that all the notes are linearly accessed by 
the Finger Finder (so, e.g., the strokes in a repeated sequence are duplicated and put in 
the data structure where appropriate) and have the key that the composition is currently in 
maintained with the stroke container, so that the measure container 404 and the 
composition line container 402 would not be needed; this is the configuration assumed by 
figure 3, but the other arrangements are considered by this invention as well, it is only the 
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means of accessing the strokes, not handling them once accessed that is the main point of 
this invention. 

Another option for the input involves the stroke container 406 when there occurs, 
at the same time, multiple strokes of different durations, as shown in figure 5A. In figure 
5A, stroke 500, a half note, is struck and held until four of the eighth notes of 504 are 
played, and then stroke 502, a quarter note, is struck and held while the remaining two 
eighth notes of 504 are played. Since the timing of the composition is not a factor in 
determining the fingering of an instrument for this invention, the program creating the 
input for the Finger Finder may internally represent the composition of figure 5A as 
shown in figure 5B. In figure 5B, half note 500 is broken into four eighth notes, 506, 508, 
510, and 512, and combined with four of the eighth notes of 504, thus creating four 
eighth note chords; for this representation, the internal data content for notes 508, 510, 
and 512 would have to include information that these notes are not to be played (struck) 
again, but they exist only for finding the correct fingering of the instrument. Likewise, 
quarter note 502 is broken into two eighth notes, 514 and 516, and combined with the last 
two eighth notes of 504, thus creating two eighth note chords; again, the internal data 
content for note 516 would have to include information that this note is not to be played 
(struck) again, but it exists only for finding the correct fingering of the instrument. 

Figure 5C shows a very similar construction as figure 5A. In figure 5C, a half 
note 518 is paired with a quarter rest 520, meaning that stroke 518 is played for a quarter 
time, then continued to be held for the duration of the next quarter note 522. As in the 
preceding paragraph, for finger finding purposes this could be refactored as shown in 
figure 5D, where half note 518 is broken into two quarter notes 524 and 526. Notice that 
note 526 is now combined with note 522 to make a chord. As above, the internal data 
representation of note 526 would have to indicate that it is not actually played, it is there 
only for finding the correct fingering of the instrument. 

The output of the Finger Finder contains information on the fingering for the 
instrument; e.g., the number of hand positions in the output data, followed by an array of 
hand positions containing information such as an indication of which hand is being 
described (differentiating between the right hand and the left hand, as appropriate), and 
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information denoting which finger is where on the instrument. For example, for a guitar 
this information would indicate which finger of the left hand is on which string and at 
which fret; for a piano this information would indicate which hand and which finger is 
pressing which key. For an implementation of this invention, an indication of which 
stroke in the composition the fingering data refers to may also be desired for graphical 
user interface purposes. 

Figure 6 illustrates an exemplary embodiment of the Finger Finder invention 
where the complete fingering of a guitar composition is shown by the embodiment. This 
figure is very similar to the graphical output of the Finger Finder For Guitar program 
copyright February 4, 2002. 

In figure 6, item 600 is the frame window of an application containing 
subwindows 602 and 606. Item 602 is a window containing a musical score for a guitar 
comprised of singe strokes and chords. Item 604 is the selected stroke of the composition 
whose complete fingering is shown in window 606. The graphics shown in window 606 
is comprised of a row of guitar fret numbers 608, a column of string numbers 610, and 
encircled finger numbers 612 (1 for the index finger, 2 for the middle finger, 3 for the 
ring finger, and 4 for the little finger, all for the left hand); thus, the complete left hand 
fingering on a guitar is shown how to play stroke 604. It should be noted that for this 
invention, if the same stroke appears again in the same composition or another 
composition, its fingering may be completely different depending on the other strokes 
around the stroke. 



